Papers with science question answering
Standardized Tests as benchmarks for Artificial Intelligence (D18-3)
Copied to clipboard
| Challenge: | Standardized tests have been proposed as replacements to the Turing test as a driver for progress in AI. |
| Approach: | et al. propose standardized tests as replacements to the Turing test as a driver for progress in AI. |
| Outcome: | a series of standardized tests have been proposed as replacements to the Turing test . the tutorial categorizes open domain and closed domain tests into two categories . open domain tests require the system to have significant domain knowledge and reasoning capabilities. |
Empowering Tree-structured Entailment Reasoning: Rhetorical Perception and LLM-driven Interpretability (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing models for science question answering lack a framework for entailment trees . ambiguities and similarities between science facts complicate the fact retrieval process . |
| Approach: | They propose a framework for building entailment trees for science question answering . they propose to infuse knowledge that bridges the gap between reasoning types and rhetorical relations . |
| Outcome: | The proposed framework improves retrieval capabilities, understanding relationships and generating intermediate conclusions. |
Two is Better than Many? Binary Classification as an Effective Approach to Multi-Choice Question Answering (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to multi-choice question answering are based on binary classifications instead of scoring each answer as a single class. |
| Approach: | They propose a simple refactoring of multi-choice question answering tasks as a series of binary classifications and propose re-framing to make them more efficient. |
| Outcome: | The proposed approach is significantly more effective across different tasks and models. |